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ABSTRACT 

In studies of classroom behavior modification, the 
experimenter or educator attempts to make valid judgments about 
desirable behavioral outcomes. Instruments of assessment to be used 
with behavior modification treatments mist be sensitive to the 
behavioral goals of principals, teachers, and public school 
officials. Moreover the treatments used in behavior modification must 
incorporate teacher behavior. Specific criteria necessary for valid 
and reliable observing and recording techniques are also 
prerequisites to instrument development. The Durham Education 
Improvement Program has developed two instruments. Coping Analysis 
Schedule for Educational Settings (CASES) and Spaulding Teacher 
Activity Rating Schedule (STARS) , to permit the study of the 
socialization process in ongoing school settings and treatment of 
behavior disorders by social agents. Two procedures requiring trained 
observers using technical aids (signal generators, and an event 
recorder with attached micro-switch keyboard) have been used; a 
third, employing wireless transmitting microphones in conjunction 
with the event recorder, is proposed. Short forms of CASES and STARS 
are appended along with recotdinq sheets used to gather data in 
classrooms. Examples of criteria for rating observation techniques 
are included. (ES) 
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(To bo presented ot Inc Al’KA meeting, Stntler- 
Hilton HoL(;.l, Los Angelos, February 8, 1969) 



U » OCM’TMINT or HIAITM. tOOCATlOW 
IWILMM 
OMJCIO* tOVCATIO* 

THI$ OOCUMtHT HAS SEtN WMOOUCED 

OHGANt/ATON OWOlNATINQ It M>*ti Of 
VltW OH OPINION | HATED DO NO? NECES 
JAMY HEMEilNT OfftOAL 0fftCE Of EDU 
CATION fOfcTION OH HOtICY 



O 

o 

UJ 



Observation#! McLhodcOegy in Ilia II/;pcrinicnlnl School Felting 

Robert L. Spaulding^* 



\N 

* 



* 




In recent yean; a broad range of hehavJor modification techniques have 
been reported In the literature* Some of these focus on individual therapy 
in the psychologist's office or in the life situation of the individual pa- 
tient* Other techniques have been developed to bring about change in groups 
of individuals in cnrrp settings, hospitals, or schools. 

GoldfrJcd an d Pomei'anss (1968) have recently reviewed the problems of 
assessment relating to behavior modification techniques and have pointed out 
that the two general areas in which assessment is most inadequate is in de- 
ciding which specific behavior end which environment should become the 
target of treatment and secondarily what are the most appropriate and effective 
behavior modification techniques* The literature on behavior modification 
In the school settings, especially in ongoing public school settings, is very 
meager. Most researchers have been occupied with identifying relevant 
variables from the broad range of behavior observable in school settings and 
in the development of reliable and valid measures of relevant variables. It 
is only in the last year or two that the literature on classroom behavioral 
analysis has begun to reflect a concern with intervention techniques in re~ 
lation to specific behavioral targets, 

* Director, The D.irhc.a Kducation Improvement Progrem, Duke University* 

Durban, North Carolina. The Durham KIP is a project of the Ford Foundation 
administered through Duke University, in cooperation with North Carolina 
College, Durham City Schools, Durham County Schools, and Operation Rredkthrou 
Jnc. 
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1 he S i fin 1 f 1 cat \ c o of Ilia Concurrent l:»nvivanncn L 

ClnssroOiM behavioral analysis has been slov; to develop because of the 
complexity of the environment in which behavior change is observed and modi- 
fied. Most classrooms are extremely complex social settings in which a number 
of social agents us well as a variety of objects serve to stimulate and rein- 
force all of the members of the group* In rddition, the aversive and rein* 
forcing consequences of behavior in the classroom selling are very complex both 
from the point of view of the natural environment and the contrived social environ- 
ment of the school. In a recent book entitled The Tech nolog y of T e aching (1968), 

B. H% Skinner has made a very definitive analysis from the point of reinforcement 
theory and it is expected in subsequent years gir Ucr attention will be given 
to programs of behavior modification in complex classroom settings. 

The Sc lectio n of Appropriate Beha vio r Modi fl oat Io n Procedures 

In studies of classroom behavior modification the experimenter or edu- 
cator is perforce involved in attempting to nake valid judgments about desirable 
behavioral outcomes, Behavioral goals in the public school setting are 

« 

further constrained by policies set down by the school boards and public 
agencies charged with the responsibility oi governing the schools. In addition, 
teacher* end principals in each school give further definition to the behaviors 
desired and those behaviors which are to be systematically eliminated or 
fostered. Instruments of assessment to be used with behavior modification 
treatments in public school settings or experimental schools must be sensitive 
to the behavioral goals of the principals, teachers, and public school officials. 
Thu treatments used in behavior rx>di f ication must also incorporate teacher 
behavlorr which are reason Vole to expect teachers to undertake and which they 
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can Jcnrn in n relatively short period of * imo. It is not practical to ox- 
peel that Lea cherts will he able to piaster reinforcement theory and make 
applications independently of specific treatment programs designed by special- 
ists in clinical or educational ps>cbology. Therefore, treatment programs 
must take into account the range of behaviors found normally in the repertoire 
of public school teachers and the likelihood that these can be systematically 
scheduled as well as the likelihood that specific new treatment behaviors 
can be introduced into the teacher’s repertoire. 

Assessment of behavior modification techniques in ongoing public school 
or experimental school settings generally boils down to the question of how 
this particular teacher can modify her behavior to provide a treatment which 
is appropriate for this particular child in this particular group of peers 
ond the school environment in which the child has been placed* The degrees 
of freedom regarding treatment are constrained by the particular setting, 
including the characteristics of the teacher and those of the peers* In the 
experimental school, greater freedom exists as to making changes in the school 
environment but only lelalivcly so. 

Requ ire pent s of an Effec tive Assessment lie th od e log y 
in the Experimental or Public^ School Setting 

Valid end reliable observation and recording techniques to be used in 
ongoing public school experimental settings must be evaluated in terms of 
specific criteria such as the following: 

1* Data collection procedures must lake place in complex school 
or social settings during the process of transaction itself 
and in such a manner that the presence of observers or equips 
tient does not continually stimulate the subjects under 
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observation. 'J h c* first introducLion of observers and equipment, 
of course, wculd bring about a dir.turbanco but after a period of 
adjustment their presence must, no longer bring about changes 
in the transactional setting under investigation. 

2. In order to be valid in the educational sense the observational 
methodology used must produce data which reflects individual 
status as well as transactions on social variables relating 

to personality, socialisation, academic achievement , and in- 
tellectual performance. 

3. Methodology used must be highly reliable from the poinL of view 
of conventional tests of reliability of observation. For ex- 
apple, data should produce inter-observer agreements of -80 

or higher on all variables, if possible. It is important in 
educational research and especially in behavior modification 
studies in school settings that the variables selected for 
assessment not be restricted only to those which yield high 
coefficients oi reliability. Many of the most important goals 
of education involve personality and intellectual characteristics 
which are only indirectly measured, and research efforts should 
to .orate lower coefficients of reliability especially during 
investigations of current treatment practices and preliminary or 
pilot programs of intervention. 

4. Data collection procedures in the ongoing school setting should 
also be relatively inexpensive so that the potential for ex- 
pansion of the procedures into a large number of public school 
classrooms is very high. The expense of data collection Is a 
function of the number of hours of actual observation and 
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recording but by far the most expensive process involves the 
transformation of data from th9 form in which it has been re- 
corded in the classroom to coded form reflecting specific 
antecedent, Intervening, and consequent variables. Not only 
is there the consideration of the amount of time spent in 
data collecting and processing, but also the level of training 
of technical personnel required during observation, processing, 
and analysis. Methodology which permits the use of specifically 
trained research technicians, assistant teachers, or even teacher 
aides or students in training can insure the wider use of the 
methodology in public schools generally. 

5. Instrumentation developed for classroom behavior modification 
studies should be sophisticated enough to permit reliable 
measures of initial status, transitional status, or post- 
status along the following variables: 

a. Pupil personality, socialisation, academic achievement 
and intellectual performance; and 

b. Teacher personality and intellectual characteristics as 
well as transactional variables relating to pupil 
socialisation, acculturation, and intellectual development. 

6. Observational technology should also permit continuous transac- 
tional data-ga the ring involving not only one teacher and one 
child, but several teachers Interacting with several children 

in a variety of environmental settings. As technology improves* 
transactions Involving two or three adults and four or five 
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children or more should become well within the technical ability 
of investigators in the experimental school setting. 

In the future it would be valuable to develop techniques for 
recording transactions and individual behavior of tvfo or three 
teacheis transacting with 20 or 30 pupils in a variety of settings 
during a normal school day. 

7. Classroom observational technology should also permit the 

development of norms so that comparisons might be made between 
the behavior of specific groups of children and their teachers 
and the characteristic behaviors of teachers and children in 
other schools in ether parts of the country. This problem in- 
volves the identification of relevant variables in the en- 
vironmental setting as well as those characterizing teacher and 
pupil behavior. It further requires the development of 
standardized settings in which instructional procedures and 
behavior modification techniques are practiced. It also 
involves the clarification of behavioral objectives both from 
the point of view of broad general educational objectives 
And the specific expectancies held by individual teachers, 
experinen teis , and therapists. 

Exanj^les of Procedu res a nd Tec hniqu es Develo ped in t he Durham 
Ed ucation I mpro vement Pro gram JLo lljce t_ These Re q ui re gen ts 

Because of the complexity of the transactional process in public 
education and the vide range of behavioral objectives, T large musbor of 
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instruments will need to bo developed to cover the full range of variables 
involved. During the lent decade the number of instruments developed lias 
grown considerably and the better known of these have been collected and 
analyzed to some degree by Research for Hotter Schools (Mirrors for Behavior , 
1968). In the Durham Education Improvement Program emphasis has been 
placed on socialization in early childhood education and the instruments 
developed for studies at this level have included two entitled A Cop ing 
Analysis S ched ule for Educatio nal Settings (CASKS) and the Spaulding Teache r 
A ctiv ity RntJjig Schedule (STARS) which permit the study of the socialization 
process in ongoing school settings and the treatment of behavior disorders 
by adult social agents. Descriptions of these instruments and their use 
along with some sample studies are presented elsewhere (Spaulding, 1968).* 

Methodology has been developed for the employment of CASES and STARS 
in behavior modification programs iv the Durham Education Improvement Program. 
This methodology is relatively inexpensive and meets to some degree the 
tequirenents set forth in the preceding section. Among these procedures are 
the following, nil of which require in situ observation by trained observers. 

1. Using paper, pencil, clipboard, stop watch, and coded tally sheets 
the trained research technician or teacher aide samples or records 
continuously the observed behavior of a child, the teacher, or the 

* Short fonas of both CASES and STARS are appended along with recording 
sheets used in gathering data in the classroom. 
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child and the teacher simultaneously. Samples are usually 
taken on a 5 lo 10 second sampling schedule for minimum 
observation periods of 20 to 30 minutes or until the specific 
environmental setting has substantially changed* Using this 
technique t lie observer positions himself in a chair near the 
teacher where the faces of the children or the individual 
subject being obseived can be easily seen, The observer follows 
a rhythm which involves observing the child, scoring, chocking 
the sampling interval on a stop watch , observing the child, 
and scoring again. Coding Is clone on the spot whether the 
individual cliild is being observed, the teacher, or the two in 
transaction. 

This particular procedure permits a wide range of data 
collecting activities in ongoing public school and experimental 
school settings and can be undertaken with very minis el dis- 
ruption of ongoing classroom programs. Observers readily be- 
come ignored by the subjects under observation and the data are 
quickly transformed for subsequent analysis. For every hour of 
observation end recording, approximately one-half hour is re- 
quired to transform the data for card punch procedures or for 
plotting on charts and graphs. The same individual who observes 
and records can prepare the necessary tables of data for card 
punching or chart production. Data can also be fed back to the 
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agents of treatment (teachers or expcriiucn tors) at the end of 
school classes on the same day. Studies using these procedures 
have demons trated that undergraduates in psychology or education 
can be trained with sufficient reliability (.80 or better) in two 
to three weeks. 

k variation of this technique involves the use of a signal 
generator to produce 5 or 10 second signals in the ear of the ob- 
server. This equipment permits the technician to dispense with 
the stop watch and maintain constant surveillance of subjects 
being observed. 

An alternative procedure which has the advantage of increased 
reliability end the ability to record the behavior of a teacher and 
more than one child In transaction at the same time incorporates an 
electrically driven event recorder with a micro-switch keyboard at- 
tached (Figure 1/. This assembly permits the observer to maintain 
a continuous recotd of ongoing behavior of an individual chlAd § 
an individual teacher, or a teacher transacting with one or two 
of even throe or four children at the same time. When a single 
teacher, a single child, or a teacher and a child, are being ob- 
served, a single technician can code continuously using CASKS 
and STARS without removing her eyes from the subjects. \he 
keyboard is memorized in the same manner that a person memorizes 
A typewriter keyboard. When a teacher is being observed trans- 
acting with one, two, throe or four children it is possible to 
vse two observers with each observer operating a different 
portion of the keyboard. When using r.he event recorder and micro- 
switch keyboard, the tiee sequence is aaintained by the horisontai 
alijgnaent of the pens And the *ovc&eni of the paper through the 
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e*'ent recorder at a constant speed. The disadvantages of this 
arrangement are, primarily, the increased time it takes to render 
the data in coded form for subsequent analysis and also the increased 
restrictions placed upon the observer in terms of mobility within 
the classroom setting* 

The event recorder is located on a portable table with 
wheels, and requires a source of electricity. If it is put in 
place before class convenes and remains in one place during the 
time the children and teachers are interacting, the equipment 
does not become a disturbing element, after an initial period 
of adjustment to its presence. 

It takes about tv;o hours of technicians’ time to remove 
information from the event recorder papers and post them for 
subsequent data analysis for each hour of observation. When 
transactional data are gathered using two technicians, and the 
data reflect the behaviors of more than one child and the 
teacher, It takes about three hours of desk work for every 
hour of observation to transform the data to numerical form. 

3* A third technique is under investigation in EIP in order to 
gather data in a large auditorium in which approximately 60 
children are interacting in a variety of ways with four teachers 
and four teacher aides. This technique involves the use of a 
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wireless transmitting microphone held by the research technician 
who moves in proximity to the subject or subjects being observed, 
coding into the mike in whispers. The receiver is placed in 
another room where a technician sits at an event recorder and 
actuates the keyboard according to the numbers heard on the radio 
receiver. This technique permits the event recorder to be placed 
in one location and not have to be moved, and gives the technician 
complete flexibility in moving about the room or throughout the 
building as necessary. The disadvantages here are that two trained 
persons are required during the period of observation, and there 
is some possibility of disturbance to the subjects observed by the 
whispering of che observer. The advantages of the event recorder 
are, however, retained and with two transmitting microphones and 
two keyboard operators at the same event recorder keyboard with 
headsets, it is possible to take data on complex transactions 
between one or two teachers and one or two children in a highly 
mobile school setting. Time to transform data from the event 
recorder paper to charts or for subsequent data processing are 
similar in this case to the second procedure discussed above. 

Reliabilities ^ Ob tai ned in laboratory Studi es 

Examples of reliabilities obtained in studies using several of these 
alternatives are presented in the following table. These are samples from 
research undertaken over the past three years in the Durham Education 
Improvement Program. 
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Table 1 



Examples of reli abilities obtained using the 
Coping Analysis Schedule for Educational Settings (CASES) 



Method of data collection 



1, Two observers using paper , 
pencil, clipboard, 10 second 
time samples, synchronized stop- 
watches, v: th 10 minutes of 
observati t of same child. 



2. Two observers using two 
event recorders and observing 
the same child for 10 minutes. 





Observers 




E x J 


E x K 


J X 



.85 


.78 


.82 


.82 


.88 


.82 


.90 


.87 


.95 



.87 
.80 
• 75 
.92 
.92 
.97 



« 76 
.75 
.80 
.86 
.92 



3. Two observers, one using an .92 

event recorder and the other .79 

using paper, ‘ pencil , stopwatch 
and a 10 second sampling procedure 
for 10 minutes of observation of 
one child. 
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A Coping Analysis Schedule 
for Kdiicali on a 1 Sot: lings ( C A S KS) * 

(Brief Foi*m for Quick Kofercnce)** 



Apj;reMl v e JF3 cl 1 /j v i or : 

Direct: attack: grabbing, pushing, hilling, pulling, kicking, name- 
calling; destroying property: smashing, tearing, breaking. 

Negative (liutppropriat e) At tent ion-Gc it ing Behavior : 

Annoying, bothering, whining, loud talking (unnecessarily) , attention 
getting aversive noise* making, belittling , criticising. 

Maniyula tin C ontrolll^ g , and Dire ctin g Oth ers : 

Manipulating, bossing, commanding, directing, enforcing rulCvS, con- 
niving, v;heedling, controlling. 

Res is ting A utho rity: 

Resisting, delaying; passive aggressive behavior; pretending to 
conform, conforming to the letter but not the spirit; defensive 
checking . 

Self -Directed Acti vity : 

Productive v;orking; reading, writing, constructing with interest; self 
directed dramatic play (with high invol vement) . 

lo se Att ention; T hink ing, P onderin g 

Listening attentively, watching carefully; concentrating on a story 
being told, a film being watched, a record played; thinking, pondering 
reflecting. 

Integrative Shari n g an d Helpin g : 

Contributing ideas, interests, materials, helping; responding by 
showing feelings (laughing, smiling, etc.) in audience situations; 
initiating conversation. 



* @ 1966, Robert L. Spaulding. 



** Revised August 12, 1968. 



8 * In l e gra tl v o So ci a 1 JjaloracLioni 

Mutual give and taka, cooperative behavior, integrative social behavior; 
studying or working together where participants are on a par. 

9. A 0 !: ?JyJ- ItK. A l UWl c LY 1 1, . f) s L\ c Jfl . a n jL Z : 

bidding or asking teachers or significant peers for help, support, 
sympathy, affection, etc., being helped; receiving assistance. 

1 0 . Pol lov ^in g. jd i r e cfcion s j> as s_i v o ly~ an A svbiiiissi.vcly : 

Doing assigned work without: enthusiasm or great interest; submitting 
to requests; answering directed questions; waiting for instructions 
as directed, 

11 . Ob ser vin g V as s iyely : 

Visual wandering with short fixations; watching others v;ork; checking 
on noises or movements; cheeking on activities of adults or peers. 

1 2 . Responding t o Int ernal St imu li: 

Daydreaming; sleeping; rocking or fidgeting; (not in transaction with 
external stimuli) r 

1 3 . Phy s_ica 1 Jjj . thdrawal or Pass ive A voidance : 

Moving away; hiding: avoiding transactions by movement avray or around; 

physical wandering avoiding involvement in acti.viti.es ♦ 



Note: Categories 3> A* £> Z* all( * A arG further coded as a_ or lb in structured 

settings to indicate appropriate or inappropriate timing or location of activity 
(based on the teacher's expectations for the setting). Example: 5a would be 

recorded when a child was painting during art period (when painting was one of 
the expected activities). Painting during "story time" or in an academic 
setting v:ould normally be coded 5b. The code _a represents behaving in a 
certain coping category at the "right" time and place; b_ represents behaving 
in a certain coping category at the "wrong" time or place. What is "right" 
or "wrong" is based on the values and goals of the teacher or authority re- 
sponsible in a given situation. 

A child might be sharing with another child in an integrative manner 
(7) some bit of information the teacher regarded as highly inappropriate. It 
would be coded as 7b since it v?as an integrative act of sharing occurring 
at the "v/rong" time in che "wrong" place, from the point of view of the 
teacher. 
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The Spaulding Teacher Activity Rating Schedule (STARS)* 
(brief Ten: 1,1 for Quick Reference)** 



(Areas of educational concern): 

JC c^^nitive T r - Tcachcr-chi.ld transactions focusing on 
modification of thinking and conceptual structures. 

^ ? . Ji G Il a YJ> f?} \ il a il a ] )A ~ Tcachcr-child transactions focusing on 
modification of social transactions, impulse control, and classroom 
routine, 

Motor Instruction - Teacher-child transactions focusing on modifica- 
tion of motor activities, including fine and gross motor control. 

Co nversing - Teacher-child transactions not focused on modification 
of child behavior. Coded as TaJJk (T) or 7 vtsjt jen JjjtS,. (L) depending 
on direction of transaction. 

Non- Child - Teacher behaviors not child transactional. Coded as "A 11 
(for teachcr-olher adult transactions) and ,r P n (for personal activities) 

B, HQlii t at (Techniques of behavior modification): 

•I AfiPX9Yill. ~ Teacher operants with generally reinforcing affect (affective 
loadings take priority over cognitive content) 

- Disapproval - Teacher operants with generally punishing affect (aversive 
loadings take priority over cognitive content) 

S S truc turing - Teacher operants setting or eliciting performance goals 
and action, or proscribing certain actions (without aversive affect) 

R Restru cturi ng - Teacher operants repeating or modifying structuring 
behaviors; when negative affect is present score as disapproval (-) , 

N Neu^ril Teacher operants conveying information (but not setting or 
eliciting performance) 

L List ening and obser v ing - Teacher atceciding to child or group operants 



* © 1967, Robert L. Spaulding. 

** Revised August 4, 1968. 
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c. 



Cognitive Structuring Categories (to be coded only during the Cognitive 
Transae t ions' "S , ” " ,v K ,‘ r,i N , ,v ' and ~"L'’) i 

J) IktLn | - task parameters given in concrete or raw datum f orm, with 
goal the derivation of concepts, generalizations, or a product in 
which understanding of a concept or generalization is implicit. 

C Con cept T •• task parameters given in terms of names of objects or 

concepts or verbal descriptions of concepts, with goal the. derivation 
of generalizations or a product in which understanding of a general- 
ization is implicit. 

G Generalization ly - generalizations given in verbal fora with task 
limited to the derivation of instances (at datum or concept level). 

1 Naming or labeling - raw data, concrete instances, or verbal de- 
scriptions of concepts or generalizations presented or confirmed 
with names attached. Task limited to the nmnorization of names 
and /or discrimination of the setting in which the name applies. 

E Evalua t ing, com me nting - evaluative or other comments on the cog- 
nitive content at hand or related content of my kind. 



Note: Teacher-child transactions (or other teacher actions) are coded at 

three levels, in the following order: 

A. At the molar level (Level A), 

B. At the modification level (Level B) within the three molar 
categories, where behavior change is desired, and 
At the cognitive structuring level (Level C) within the 
cognitive transactional molar category only. 



C. 



School^ 

Grade 



Beginning Time 

Setting (situation and activity) 



Observer 

7.2 Date 7 

CASK? - Data Sheet 

End Time 



Child or 1 ~ 
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